Microsoft Kinect-Based Artificial Perception System for Control of Functional Electrical Stimulation Assisted Grasping
نویسندگان
چکیده
We present a computer vision algorithm that incorporates a heuristic model which mimics a biological control system for the estimation of control signals used in functional electrical stimulation (FES) assisted grasping. The developed processing software acquires the data from Microsoft Kinect camera and implements real-time hand tracking and object analysis. This information can be used to identify temporal synchrony and spatial synergies modalities for FES control. Therefore, the algorithm acts as artificial perception which mimics human visual perception by identifying the position and shape of the object with respect to the position of the hand in real time during the planning phase of the grasp. This artificial perception used within the heuristically developed model allows selection of the appropriate grasp and prehension. The experiments demonstrate that correct grasp modality was selected in more than 90% of tested scenarios/objects. The system is portable, and the components are low in cost and robust; hence, it can be used for the FES in clinical or even home environment. The main application of the system is envisioned for functional electrical therapy, that is, intensive exercise assisted with FES.
منابع مشابه
Dictionary Learning for Robotic Grasp Recognition and Detection
The ability to grasp ordinary and potentially never-seen objects is an important feature in both domestic and industrial robotics. For a system to accomplish this, it must autonomously identify grasping locations by using information from various sensors, such as Microsoft Kinect 3D camera. Despite numerous progress, significant work still remains to be done in this field. To this effect, we pr...
متن کاملGenetic Feedforward-Feedback Controller for Functional Electrical Stimulation Control of Elbow Joint Angle
Background: Functional electrical stimulation (FES) is the most commonly used system for restoring functions after spinal cord injury (SCI). Objective: In this study we investigated feedback PID and feedforward-feedback P-PID controllers for regulating the elbow joint angle. Methods: The controllers were tuned based on a nonlinear muculoskeletal model containing two links, one joint with one de...
متن کاملComparing the Effect of Functional Electrical Stimulation and Functional Exercise Therapy on the Treatment of Ischemic Stroke: A Randomized Clinical Trial
Background and Objectives: Stroke is considered as the third common cause of disability and mortality in the world. Therefore, it is important to find a new treatment for increasing the rehabilitation of disability after stroke. The aim of this study was comparing the effect of functional electrical stimulation (FES) and functional exercise therapy (FET) on the treatment of ischemic stroke (IS)...
متن کاملMulti-Modal RGBD Sensors for Object Grasping and Manipulation
RGBD sensors, such as the Microsoft Xbox Kinect [1] are types of multi-modal perceptual sensors that have appeared in recent years. RGBD sensors have become standard perceptual tools for robots as they provide a unique multi-modal approach to perception. A vital pre-cursing challenge in object grasping and manipulation is object pose recognition. A robot must identify the pose (i.e. orientation...
متن کاملLocalizing Grasp Affordances in 3-D Points Clouds Using Taubin Quadric Fitting
Perception-for-grasping is a challenging problem in robotics. Inexpensive range sensors such as the Microsoft Kinect provide sensing capabilities that have given new life to the effort of developing robust and accurate perception methods for robot grasping. This paper proposes a new approach to localizing enveloping grasp affordances in 3-D point clouds efficiently. The approach is based on mod...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
دوره 2014 شماره
صفحات -
تاریخ انتشار 2014